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FOREWOl 



Tie Trairiing<^Technical Area of. _ the,; US Army Research 'Institute for 
the ; Sgjiavibral and Social Sciences (ARI) has actively pursued a program of 
. research in support df the systems engineering. o£ training. A major focus 
of this research is to develop the fundamental data and technology rieces- - 
sary to field integrated systems for improving individual -job performance . 
Such- systems include Skill Qualification Testing, job performance aids $ 
training courses -in schools and in the fields performance criteria and 
management and feedback systems. >J 

Training for the Skill Component, the written part of Skill Qualifi- 
cation, tests , tends to vary widely from unit to unit. In addition, at the 
time' this research was conducted (1981) it was on this component of Skill 

Qualification Tests that soldiers performed least successfully. 

■ ■■ * ^ _ j 

Tfi^s report describes a method for training soldiers scheduled to 
take written Skill Qualification Tests. - The method ^employs diagnostic 
^ pretests which carl be developed and administered by battalion level train- 
ing personnel. The pretest method resulted in superior test performance. 
Results of this research have implications for individuals concerned with, 
preparation for a variety of written tests. : * Sj 



TRAINING FDR SKILL QUALIFICATION TESTING 



• B RIEF _- ; ; — ; — : - 

# " 

Requirement: , « -- . 

/ - > 4 . 

To determine the effects of administering a diagnostic pretest on 
' soldiers' SQT performance. "| 

Procedure:' ; j '• 

A pretest entitled Skill Qualification Training Diagnostic was made 
up from the 1-131 Infantryman Soldier's Manual and 1980 SQT Notice . 
After field validation, locally developed Scorable Units were intermixed 
with Scorable Units drawn from the 1980 Skill Component for enlisted 
infantrymen. Within each 1980 Skill Component Scorable Unit, test # 
questions were scrambled and answer* choices for each question were 
scrambled to. prevent test compromise. Participants were not informed _ 
that 1980 Skill Component material was. part of the Skill Qualification . 
Training Diagnostic. The pretest was administered to infantry soldiers 
at Ft. Myer a'nd Ft. Bragg, they received immediate feedback about pretest 
performance and their. units received summaries of their troops results. 

Findings: 

i-i Scorable Units developed from the; SQT Notice and Soldier's 
Manual* closely resembled .Scorable Units in the 1980 Skill Component. 

2. Soldiers performed at about the sam£ level on locally-developed 

material as on 1980 Skill Component material. 

v. d 

■' 3 Pretesting permitted trainers to distinguish tasks that needed 
concentrated 'training from tasks on which soldiers were already proficient 

4. Pretested soldiers performed better on the official 1980 Skill 
Component thart did non-pretested soldiers. 

Utilization of Findings: 

>_ . . ' 

Developing arid administering* pretests to troops scheduled to take 
" Skill Qualification Tests could save training time spent on ta^ks soldi'ers 
already know, could supplant post SQT remedial training, and could 
reduce soldiers 1 - test anxiety, z • 
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: TRAINING FOR SKILL QUALIFICATION TESTING 

INTRODUCTION - 

^" The Skill QUal if icat ibii Test (SQT) program is n relatively now one; 
It 'was' introduced in 19 77 arid is still undergo ing dcvelopinent and revi- 
sion. Its principal Instruments are' performance-based, c r iterion-rc f erenced 
tests of taslcs critical to soldiers' duty pos itioris--.tasks detailed in 
Soldier's .Manuals. Test results are intended to be used to diagnose 
Individual - training needs, and to direct training arid personnel management . 

SQTs" ar,e typically broken' down into three components: on-the-job 
testing called the Job Site' Component., hands-on testing called the 
Hands-on Component , and written testing called" 1 the Skill Component . The 
Job Site Component includes such tasks as marksmanship and physical 
fitness. Supervisors judge their soldiers 1 proficiency after 6bserving 
"per formance during normal * pract ice sessions. The success rate for. 
performance on this component has been remarkable, with scores of 100% : 
commonly found. The Hands-on Component tests* actual performance of 
selected critical tasks such as operating a field telephone or putting 
oq a* protective mask. Success on this component too has been . widespread . 
The wr-itten portion of the test, the Skill Component, has achieved the 
lowest success rafce of ^the three components. It is with the written ' 
component of the 9QT that this research deals ^ • - t 

The Skill Component (SC) made up of tasks* that are impractical* 
and sometimes impossible, to test in a hands-on form. For example, 
map reading is a logical candidal for written testing and so is calcu- 
lating the velocity of a stream. One way to account for the lower . 
success rate for the SC may be by ^xgmining the way many soldiers prepare 
for it compared to the way they prepare for the Hands-on Component . 

*• . . 

Sixty days prior to scheduled testing, soldiers are provided with 
an SQT Notice that informs them, in substantial detail, about the tasks 
that will be tested in all three, components . For the Hands-on Compo- ;- 
nent," SQT Project Officers are responsible for setting-up and equipping 
-test stations for each task listed. 'Soldiers who are to be tested 
"practice Th* tasks at the stations at which they eventually will be 
tested: As they complete each task, proctors tell them if the perform- 
ance Ja ; s successful; i.e., if they scored GO or *N0 GO. When soldiers • 
finally take this component for record^ they are performing familiar 

tasks . in a familiar environment . • m 

"' ' > 

. To prapare for the SC, soldiers are encouraged to study their 

Soldier,' s Manuals . In some units they may also attend lectures about - 
.material' to be tested or do hands-on practice*for the SC. A better way, 

hpwe.ver, : to prepare soldiers to take^the written .test may be to imitate 

the form of preparation for the Hands-on-Component — to prepare to perform 
familiar tasks in a familiar environment;. The suggestion here is that - 
the way^'to prepare to take a written test is by taking a written test. . 

: To' explore this hypothesis, written pretests were administered to 
basic infantry soldiers. They were provided with immediate feedback 
about test performance and each participant was equipped with a^ record 



of his"" performance. In addition, ,ench unit Was provided with a summary, 
of their troops' results. The pretest administered 'was called Skill- 
qualification Training Diagnostic (SQTD-) .because it was intended to -/ 
diagnose training needs prior to formal Skill Qualification Testing.- 

'OBJECTIVES ... 

The objective's of this research were to test the effects of: 

1. diagnosing training needs prior to SQT administration 

2. shifting' emphasis 'from remedial training (post SQT) to 
pre training (pre SQT) * 

3. reducing arti factual error in the testing process % • 

4. , developing -test items from SQT Notices and Soldier's 

T Manuals . * * 

I " • 

METHOD 



Subjects 

« . _. " . ._ ' * 

More than 1000 11B noncommissioned officers (NCOs) and enlisted men 
stationed at Ft. Bragg end Ft* Myer participated in this* research. NCOs 
participated in order to become familiar with testing procedures and to 
learn in which areas their troops needed training: The data analysis in 
this report* includes only thosej enlisted personnel for whom official SQT 
scores were made available. x . . 

_ _^ n __ • » 

Test Development' • - * 

Using .SQT Notice 11B 218o\aC) TR1/2N and Soldier's Manual FM, 7-11B1/2 
dated 7 July 1978, test items were developed that covered all 12 tasks 
to be included in the 1980 Skill Component for 11B1 soldiers. Every j 
ef fotit was made -to duplicate style, fontia.t, and language , common to prior? 
years' written SQTs for basic infantry soldiers. e Items developed .were 
used during the validation phase of this research and, after rminor 
revision, during the main data -gathering phase. * 

Field SOPs were developed for froth validation and SQ.TD construction 
phases of the research (see appendix); Answer sheets for validation 
were locally developed (see appendix). Mark sense answer sheets, the 
same answer sheets used for the official SQT, were obtained from the 
Army Training Support Center for use during the data" gather ing phase. 

Test Validation 

Sixty-nine soldiers assigned to the llBlO^Miiitary Occupational Specialty 
(MOS)*' participated in this effort. Test items were typed individually, 
on 5 x 8 index cardi. -In an interview format; the items were- presented 



one at a time and each was asked to comment on the content of 
.the item and whether it tapped information critical. to the 11S1 MOS. At 
the enc *l°f the interview, each soldier was presented with ^ record of 
his performance (see appendix) that could be used to direct his training 
. t ^ ie .^Ci Art item analysis was performed on these data and items were 
modified in accordance with indicators that emerged. : \ .' ' 

1 m - ' ' ■ r ; ' 

SQTD Con struction * - 

The twelve Scorable Units (groups of questions under /single task headings) 
locally developed from the SQT Notice and Soldier 's^ Manual were intermixed 
Vith twelve Scorable Units taken from the 1980 Skill Component. Besides 
intermixing the task 'groupings, 1980 Skill Component items under each 
taslt heading were scrambled and the answer choices following each, item .. 
were scrambled to prevent test compromise. Participants were not in- 
* formed that that SC questions were included in the SQTD. Official SQ 
Questions were included to permit a comparison of locally developed 
questions with official SC questions in terms of effects on *1980 SC 
performance . 

The % 24 Scorable Units (12 locally developed and 12 official) were 
separated into 4 test booklets each of which included half of the tasks 
to be tested in the 1980 written SQT. Booklets 1 and 2, therefore, 
covered exactly the same tasks, but, generally, included different 
questions on those tasks (in some cases, questions developed from the 
Notice and Soldier' s Manual turned out to be the same questions included 
in the 1980 SO, The same was true of 'booklets 3 and 4. The decision 
* ??? onl y_^ a ^ f of the full number of tasks, for each session was based 
on the desire to confine sessions to one hour each (15 min. introduction-, 
30 min. testing, 15 min. feedback) . Each booklet was made, up in the 
Skill Component' format . Each was headed by a cover sheet that was 
followed by a sheet providing instructions about the way to take the 
test , sample questions , and a sample answer sheet . 

The following tasks were' included in the 1980 SC for Track 1 
infantrymen: ' » 

Perform mouth-to-mouth resuscitation and external heart massage 

Apply first-aid for wet or cold iniuries 

* . ■ ■ w _ ■ ~ ; ■ J 

Identify a chemical agent using t ABC-M8 Detector Paper 

Administer antidote to bloo^-agent casualty 

Move as a member of a fire .team - 

Select temporary battlefield positions 

Use visual signals to cpnt;rol "movement (dismounted) 

Identify terrain features' (nat-ural and manmade) on the map 

Determine /the grid' coordinates of a point on a military y 
map using the military gricl reference system v 

. 13 




10 - Conduct a preoperational inspection of the Dragon tracker 
and round 1 



li^- Perform immediate action procedure^ for a Dragon misfire 
12 - Neutralize enetnv mines 
.In future sections, these tasks witf^a identified by number: 

' . * - ; RESULTS | 

Pretest Development <k 

Test questions .developed by using the SQT Notice and Soldier] s Manual 
proved to be a good match with questions in the 1980 Skill Component. . 
In the case of tasks 3„ 7, 8 arid 9, description of material to be .tested 
which was offered in the SQT Notice was detailed enough to permit «both 
sets of questions to be essentially identical- Therefore, one-third of 
a locally deVeloped pretest prepared without exposure to the 1980 SC 
exactlv matched the SC. Questions developed to pretest. tasks 1, 2, 4, 
5' and 12- were similar to those in the SC. That is. they tended to tap 
the same information needed to answer SC questions. Questions developed 
for tasks 6, 10 and 11 were substantially different from questions on 
these tasks in the SC. It seems reasonable to assume, however, that if 
soldiers were "unable to answer questions on any part of a task, a thorough 
review of the whole task would be needed before record testing. That 
is, the assumption was made that good or poor performance on locally 
developed Scorable Units which differed from Units in the SC would be a 
valid indicator of preparation needs. Table 1 compares soldiers performance 
on ARI-developed questions with those of the 1980 SC used in the SQTD. 
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Table 1 



Percent of Soldiers Who Scored GO dri Locally 
Developed arid SC Questions on the SQTD 



TASK 
No. 



ARI 
% GQ 



N 



SC 

% GO 



» 






Old Guard 








1 




66 


(99) 


51 


(833 


+2.05* 


2 




84 


(563 


87 


(1143 


- .53 


3 




50 


(1143 


41 


(565 


+1 .09 


4 




4: 


(993 


6 


(833 


- .'^2 


5 




10 


(993 


22 


(833 


-2.22* 


6 




93 


(833 


75 


(993 


+3.27* 


7 




91 


(563 


94 


(1143: " 


- .71 


8 




31 


(993 


43 


(833 


-1.69 


9 




48 


"(1143 


45 


(56) 


+ .37 


ro- 




25 


(1143 


34 


(563 


.-1.22 r 


il 




47 


(83) 


38 


(993 


+1.23 


12 




32 


"(563 


20 


(1143 


+1.71 




X 


= 48 




X = 46 








SD 






SD = 27 












*3 















82d Airborne 








r 




65 


(513 




62 


(42) 


+ .29 


2 




89 - 


(633 




75 


(68) 


+2 .09* 


3 




38 


(683 




40 


(63) 


- .24 


4 




14 


(42) 




10 


(51) 


+ .60 


5 




26 


(42) 




18 


(51) 


+ .94 


6 




80 


(51) 




^8 - 


(42£ 


-1.04 


7 


^^^^ 


92 


(63) 




87 


(68) 


+ .94 


8 


48 


(42) 




'47 


(513 


+ .10 


9 




44 


(68) 




29 


(63) 


+1.78 


10 




43 


(68) 




46 


(63) 


+ .35 


11 




63 


(51) 




59 


(42) 


- .40 


12 




6 


(63) 




9 


(68) 


- .65 




X 


= 51 




X 


= 47 








SD 


= 28 




SD 


= 28 






i 


<.05 




Z '5 i 


• 96 


(2 tailed) 





5 
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The top half of Table 1 displaying perfprmance by Old Guard soldiers_ 
shows no significant differences between locally developed and SC questions 
for the majority of tasks (r = _..?$). The lower half of the Table showing 
performance by 82d Airborne soldiers shows a similar correspondence 
between ARI and SC tasks (r = .97). However, scoring procedures for ARI- 
developed questions were calibrated, on the basis of Old Guard data, so 
that performance on both locally developed and official SC questions 
would, correspond.- That 4s, scoring for 82d Airborne soldiers was relaxed 
for ARI questions that had been shown to be more difficult than SC 
questions and made more rigorous for ARI questions that were easier.- 
Nonetheless, both halfs. of Table 1 show correlations close to the same 
values. .The point here is that a pretest developed from information 
gathered from a SQT Notice and Soldier's Manual can predict performance 
on a Skill Component with a high degree of accuracy. 

* — ... _ 

Diagnos tic Eff-efct-& ~~ 

The sqtd was developed to diagnose training needs prior to formal testing. 
As Table 1 shows , performance by soldiers on locally developed test 
items closely resembles performance on the SC items. Figure 1 displays 
a ranking of ARI-developed scorable units from easiest to hardest for 
both groups of infantry soldiers . 

The tasks tend to fall into 3 groups. The three tasks at the top of the . 
figure are those on which both groups are proficient and to which little 
training time need be devoted. The si* tasks in the center of the graph 
require an intermediate amount of training, and the three tasks at the 
bottom of the graph require the. greatest concentration of training 
effort. The intermingling of subgroup percentages stresses the similarity 
of performance by both groups of soldiers with two exceptions. 82d . 
Airborne soldiers performed better on tasks covering the medium antitank 
assault weapon called Dragon than did Ola Guard soldiers. This outcome 
is not surprising, however, since Old Guard infantry soldiers do not 
work in their MOS. and are not equipped with Dragons. Figure 1 also 

. shows ranges of -performance restricted enough. so that subgroups pretested 
(for example, platoon level groups) fall into a ranking close to that ot , 

' the mean performance values computed for the cumulated group. The 
indication here is that performance by small numbers of soldiers might 
be used effectively to predict the performance of a larger group. 

SQT Effects "yf - 

It was expected that a substantially greater number of soldiers whose 
training needs were diagnosed by pretesting would perform better on the 
SC of the 1980 SQT than they had on SQTD, Table 2 shows z values for 
these correlated proportions (these computations deal with changes from 
NO GO to GO corrected for changes from GO to NO GO). 

The expectation was met by the great majority of the groups being analyzed. 
In some cases, for example tasks 2, 6, and 7 no great improvement was 
anticipated since most soldiers had already achieved GO on these tasks. 
• i n the case of tasks 3 and 8, a greater percentage of soldiers changed 
from NO GO to GO than from GO to NO GO but these percentages are not 
statistically significant. J- O 
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'USE VISUAL SIGNALS TO CONTROL 
MOVEMENT 



APPL Y FIRST AID FOH Wt X OH COLD 
INJURIES s 



SELECT TEMPORARY BATTLE FIELD 
POSITIONS 



0% 



PERFORM MOUTH TO MOUTH RESUSCl 
TATION AND EXTERNAL HEART MASSAGE 



PE n F O f \ M I MM C D I A T E AC T I Q N PROCE 
DURES F-OH A DRAGOJsf MISFIRE 



IDENTIFY A CHEMICAL AGENT USING 
ABC M8 DETECTOR PAPER 



DETERMINE GH ID COORD I N A T E S 
OF A POINT ON A MILITARY MAP 



IDENTIFY TERRAIN FEATURES ON THE 
MAP 



CONDUCT PREOPE RATJON AL INSPECTION 
OF DRAGON TRACKER AND ROUND 



MOVE AS A MEMBER OF A FIRE TEAM 



NEOTH ALIZE ENEMY MINES 



ADMINISTER ANTIDOTE TO BLOOD 
AGENT CASULTY 



25% 



50% 



75% 



O AO 09 OA A 



o o 

O OA • A A A O 



\ 

AOO O •AOAO 



aoa ao«o d 



A 

•o 



pO A OO • A O 



o 

o o 



Q \ A • OA OO 



100% 



O O _OQ • AO 



O* A 

OA A O O 



R A NGE OF WORST T O BEST SCO R E S - 
TOTAL SO LP IE R A V E RAG E % GO • 
SMALL GROUP AVERAGE % GO 

OLD GUARD O 

87DABN A 
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Table 2 



Differences Between -Pretest and SQT Performance 



• ARI 'Items 



SC Items 



% A 



Task No. Go , to No-Go No-Go 



Qq-JLq -N0---G0 So--Xa to jGo 

-, ; ^ 



N 



Old Gqard 



1 

2 

3 : 

V 

5 

6 

7 

8 . 
9 

10 : 
11. 
12 



18 , 

2 
17 

1 

4 

5 

5 
13 
10 

4 

7 

4 

X = 7 
SD = 6 



26 


, (83) 


- x -1.20 


' ii 


28 


(99) 


-2.72* 


11 


' 1 (26) 


v -2 . 50* 


3 


. 10 . 


(114) 


-1*94* 


56 


(56) 


-2.61* 


9 


34 


(114) 


-3.81* 


42 


(83) 


-6.25* 


0 


52 


(99) 


' -7.21*; 


51 


; (99) 


-6.33* 


. 5 


, 52 


(83) 


-6.22* , 


6 


(83) 


• - .32 


% 


IS 


(99) 


-3.89* 


. 5 


(56) 






.3 


(114) 




31 


(99) 


-2.71* 


18 


22 • 


(83) 


- .63 


25 


(1.14) 


-2.53* 


9 


20 


„ (56) 


-2 . 04* 


44 


(114) 


-5.77* 


,11 


46 


' (56) 


-4.63* 


35 


(83) 


-4.32* 


8 


29 


(99) 


-3.45* 


68 


(56) 


-7.55* 


3 


62 


(114) 


-7.32* 


X = 


32 




X = 7 


X = 


31 




SD = 


19 




SD = 5 


SD = 


18 * 





82 Airborne 





















1 


23 


12 


; (51) 


+1.86 


2 


■ 29 


; (42) 


-4 .«4*,. 


2 


11 


6 


(63) 


+1.21 


4 


19 


(68) 


-3.12* 


3 


19 


22 


(68) - 


- .31 


19 


29 


(63) 


-1*44 . 


4 


9 


33 


i (42). 


-3.70* 


0 


* 4 .37 


(51) 


-6.08* 


5 


V 17 


29 


(42) 


-1.77* 


0 


39 


(51) 


-6.24* 


6 


2 


25 


(51) 


. -4.42* 


5 


12 


• (42) 


-1.70* 


7 


2 


8 


(63) 


-1.89* 


4 


8 


(68) 


-1.16 


8 


17 ' 


26 


(42) 


-l v 37 - 

-r.08 


20 


" •27 


^51) 


-1.02 * 


9 


13 


26 


(68) 


6 


» 43 


(63) 


-5.29* 


10 


io 


31 y 


(68) 


-3.28* 


9' 


32 


. (63) 


-4.84* 


11 


10 


' ■ 29 


(51) 


-3.04* 


7 


.29 


(42) 


-3.67* 


12 


0 


49 


(63) 


-7 . 00* 


4 


'35 


(68) 


'.-4:97* 



V 



p<.05 



11 
7 



X - 25 
SD = 12 



z = i.64 (one tailed) 



X 7 
SD = 6 



X 
SD 



28 
.11 



» ' 



18 
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Anoaher approach to measuring SQT effects is to compare the percent of 
preteste'd soldiers who scored GO bri each task with the percent of .soldiers 
who were not pretested but scored GO. Table 3 shows these comparisons. 
These dat/a represent performance by 82d Airborne soldiers- only, since 

' the arrangement to pretest Old Guard soldiers included an agreement to^ 
completely pretest all infantry enlisted soldiers and NeOs. There is , . 
then, no non-pretested Old Guard comparison group. The notable point 
about these data is that the non-pretested groups consist of soldiers 
assigned to the same battalions as the pretested groups. Insofar as the 
SQTD drove training for all enlisted infantrymen within each battalion, 
any comparative effects would be a function of SQTD experience alone. 
That is, they would result from increased familiarity with the SQT 
testing materials. and procedures (reduction of art if actual error in the 
testing process), and immediate feedback about -performance. In th? , 
great majority of cases more <pre tested soldiers scored GO on the SC 

■casks thatvdid non-pretested soldiers, and in eight instances these 
differences are significant. ~ . ' £ , 

The principal focus of this research was to determine whether diagnostic 
i. pre testing would improve soldiers' performance f>n written SQTs. •- 

Table 4 compares official SC performance by SQTD pretested .Old Guard 
soldiers with performance by the whole population of enlisted infantrymen. 
Values for the Army population are adjusted to exclude pretested soldiers. 

Vith one exception, more pretested soldiers scored GO on -tW SC tasks 
than did the population of infantry soldiers, ^and in 16 instances these 
differences are statistically significant.. The single e ^P^ on *if rn 
'task on which both groups of pretested soldiers were proficient pt*pr to 
• SQT training on the task. , • * . 

in summary, this research demonstrated that diagnostic pretests developed 
by trainers can predict soldiers training needs even if only a sample of 
' soliders scheduled to take written SQTs are pretested. Most importantly,., 
it showed that pretesting can promote better performance on written 
SQTs . i 



CONCLUSIONS 



The use of diagnostic pretests/may be the most efficient and effective 
Way to prepare soldiers to take written SQTs. First, they can allow 
trainers to distinguish 'tasks soldi.ers already know from those that need 
intensive draining and so avoid squandering limited training time. • 

. Second, these pretests shift emphasis to .individual training before 
testing rather than post test, remedial .training, which may be difficult 
to schedule because of delays' in receiving test results or interference 

-. resulting' from cycling to collective field training . ^ Finally,, if the 
pretest % set up to mimic the St environment as closely as possible 
soldiers may acquire V greater feeling of mastery of the test situation 

*> which might result in better- performance on the SC. ^ 




Table 3 

Differences Between Pretested arid Non-Pretested 
Soldiers Who Scored GO bri the SC\ : 

+, : 

ARI ScorabJe Units 



Task No. 



1 , 

2 

3 

4 

5 . 

6 

7 

8 

9 

.10 
11 

12 



Pretested 
% GO N 



55 
87 
4S 
43 
38 
98 
95 
59 
57 
63 
84 
56 



X = 65 
SB = 21 



\ . ■ 
. (51) 

,(63) 

T (68) 

(42) 

(42) 

(51) 

(63) 

(42) 

(68) 

(6») 

(51) 

(63) 




Not Pretested 1 

% GO N , z 

62 (4,44) 2 .97 

79 «v (363) +1.48 

45 * \ (363). - .31 

' 38 . (444) ' + .64 

2-5 (444) +1.83* 

89 (444)- +2.00* 

93 " (363)./ + .59 ^ 

45 . * (444) HI. 75* 

57 (363) 

60 (363) — - 

73 (444) +1.69* 

23 ("363) +5.50* 



D = 23 



Sg Scorable Units 



1* 

2 
3 
4 
5 
6 
7 
8 
9 

10 

ii 

•12 



88 
87 
49 
47 
51 
95 
96 
53 
65 
68 
83 
40 



X 
SD 



69 
20 



(42) 




62 


(444) 


+3.38* 


(68) 




79 


(363) 


+1 . 54 


(63) 




45 


(363) 


• + .60 


(51) • 




38 


(444) 


+1.29 


(51) 




25 


(444) 


+3.61* 1 


(42) 




89 . 


(444J 


+1,. 22 


(68) 




93- 


(363) 


+ .94 


(51) 




45 


(444) 


+1.08 # 


(63) 




57 * 


(363) 


+P.27 


(63) 




60 


(363) 


+1.23 


(42) 




73 


(444) 


+1.41 


(68) ; 


I 


23 ' 


(363) 


^2.98* 




X 


= 57 








SD 


= 23 

















* p < .05 



1.64 (one tailed) 
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Table 4 



Differences Between Pretested Old Guard "Saldiers and 
Non-Pretested Army-wide Infantrymen Who Scored GO on the SC 



Task _ Old Guard . Army-Wide 

No. % GO (N=56-114) %G0 (N=6910) z 

. - ' ARI Scorablfe Units 

r 

I 76 63 - +2.60* 
2~~* *' ' 93 82 +2.20* 

3 s. 73 47 . +5.20*^ 

4 45 41 + .80 

.5 ; 58 ' 24 ^8.50*' 

6 94 89 +1.67* 

. 7 91 < 93 - .67 

8 53 37 . ' +3.20* 

9 61 51 »+2.00* 

10 65 54 +2.20* 

II 76 59 - +3.40* 
12 77 ' 27 •• +8.33* 



X = 72 X = 56 ' • 

SD i » 16 SD = 23 



SC Scorable Unit , 

— " : : '. ) 

1 71 * 61 +2 . 00* 

2 a 94 81 - ' +3.25* 

3 * ~f 66 41 +2.71* 

4 58 * 40 +3.60* 

5 70 24 " +9102* 

6 92 90 + .67 

7 94 . ~ 93 + .50 » 

8 47 39 ' +1.60 

9 54 51 +1.43 

10 .61 54 +1.00 

11 • 65 60 +1.00 

12 55 



29 +6.5^ 



g < .05 



X - 69 X - 56 

SD - 16 SD - 23 



i;65 (one tailed)' 



* : . ' ■ • - - : i . 

Trainers who make up diagnostic pretests wduld have afi -opportunity to 
review tasks less, frequently practiced in their units_. _ ;ATsb^_|hey_ 
would be reminded of differences between local and ■ Soldier f s Maftual 
procedures on some # tasks In addition, trailers can trade off remedial 
training time- against time invested in making up ciiagriostic pretests. 
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PPENDIX 



0 P^ 



i S 
SQTD -(DEVELOPMENTAL^ 



- v 



Introduce self <> £ 

... [ . .. ✓ : " 

Identify Organization - - * 

- -'- -*.-'■ - -! x t - ■. ^ : 

Describe purpose of Mini-SQT 

«♦ » _ 

------ % 

Describe task(s) to be performed 

Emphasise ? (for research, not. for record" ^ 1 ■ • 

Fill out identifying 6«ata on 'Record Sheet . ^ ^ * 

Fill in task identification on participant 1 s take-away sheet ^ % -. 

Display cards one^by-one and question participant while filling out Record Sheet; - ' \ 

"Would you. please read the General Situation and try to answer the question printed- on . 
this card?" '* INTERVIEWER! < RECORD ANSWER BY LETTER OR RECORD 0 IF PARTI C IP ANT ' CAN 1 T ANSVER 

i. "Is "the General Situation clear/confusing?" RECORD YES OR NO * ' > 

2s : "Is the question clear/confusing?" RECORD YES OR NO , " .. ' 

3. "Are the answers clear/confusing?"., RECORD YES OR NO - ( 

4. IF" PARTICIPANT IS UNABLE TO ANSWER QUESTION, ASK "why hot?" DESCRIBE BRIEFL¥j* 

5. ' IF PARTICIPANT ANSWERED QUESTION, ASK "How sure are you that* the answer you 

•* chose* is ttre right one?" - , . * '■ : 

J/. a. I'm completely sure; that f s. the answer 

b. I** pretty" sure }^ ' «■ . " 

c. 1 1 m not really sgre 

d. . I jus tL guessed . J* 

} t [ _ RECORD PARTICIPANT'S CHOICE 

6. "In you^-opinion* - is the material that this question is based ph CRITICAL to your : v 
HQS? That is, do you think If ? s a question that should be Included in. your test?"' 



1 ' RECORD YES OR N& 



RECORD ANY RELEVANT COMMENTS' ' 

Provide or confirm correct answer (back of each card,;Tbwer right corner). Review 
question* if necessary. ^ 

■ m ' fcheck appropriate response category on- participant ,3 s take-away sheet.' 

After 6 Scor^Dle Units are surveyed, explain information in take-away sheet to 
participant . _ 



■t icikant . 



•1. 



Thank part 

> 
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third, also try not to skip any questions. Fill iiv an- answer for each __ - 
question: as you eonie to it; For just about everyone taking the test; there will- 
be inbre t^an enough time to review all of the questions, , 

Fourtli, there is one and only one correct ^answer * for each question. .You'll 
know* you/made art error if you "see that you filled in more than one Circle in any. 
row. ^ — . : ,\ 



Finely, all of the questions; in'the teat booklet are mgiiberad 'consecutively - f ' 
so that each question number exactly 'correspond? tQ\the sane number pti the 
answer shgret • > 

Today is yani .opportunity to learn. how to fill out the answer sheet> correctly . 
If. you have \any questions about how to f iil' it .ouC, don f t hesitate to ask. Just 
signal one. of thfei people .administer ing or jDroctorihg tTie exercisV. 

After you h^ve hao\ 30 minutes to take this exercise, we 1 11 distribute 
Results Sheets like this.. Vv ^ ; - _ 

' _ ' ; . t ' f i ' 

-DISPLAY RESULTS SHEET - . " 

On these sheets you can mark whi<ch questions you /answered correctly or incorrectly 
T^ke, the marked up Sheet with you when you leave^ere today . j- 

DISTRIBUTE SLACK PENCILS ^ ■ 



DISTRIBUTE # ANSWER' SHEETS - - % | .'_ v 

_ ^ . "_' .. * ' ...T ** J __ _i l_ . _. 

- LocJk at thja^out of your answer sheet. Yfcu can see that it is arranged in 

bTocks with* large blue numbers. -. v 

DISPLAY FRONT OF ANSWER* .SHEET--POINT TO BLOCK 1. 

1 t ' _ _ ■ - 

Look 'along the top row of block i. Print the letters of your, last name in the 

white squares along the top rdw starting all the way over to your left. 

In-thg- column below each letter Qf your lasf name, blacken the .circle containing 
that letter. For .example, % tf the^ame I had written in along the tpp row were 
'SMITH, I'd blacken the/'S" 'circle in the first blue column, the n M" circle in 
the white cblunn (next i& it, the f, I" circle . in the .next blue column, and so 
forth. If you have any. questions , please signal /a proctor ■ to help you to fill 
in the answer sheet; '' V 

(JAIT FOR LAST NAMES TO* BE ENCODED : • v , : 

Look along *th^ £6? rfcw of block 1. At 'thfe right end fill in the^two white 
squares with your- first* and middle initials. Then txlacken the corresponding 
circles in the columns below. . 



WAIT FOR INITIALS TO BE ENCODED 
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took at block 2. Write your social security number in the top row amLblacken the 
corresponding number circles Underneath. : 

WAIT TOR SS NUMBERS, TO BE ENCODED * f ' 

For block number 3> fill in test number in ^he leftmost ojhite square in the 

top row and blacken the. corresponding circle underneath. 

WAIT FOR BLOCK 3 TO BE FILLED IN 

Leave block 4 blank. For block 5, along the top row fill in 80 for the year, 
- -for the month, and # f or the day. 



^ WAIT FOR DATE TO BE FILLED IN 

Leave block 6 blank. For blocks?, write your primary MOS beside the letters PMOS; 
fofifctxanpie, 11B10. 

Then^write your duty fids' beside the letters DMOS. Even if it is the same as your, 
primar^MOS , write* it in. . ' 

At the bbttbn of block 7 in the space under the letters P^R-O-M-0 write a number 
which represents your total years of fonnal education. 

In block 8f blacken the circle beside AA. 

In block 9, write your pay grade in the white blocks at the top arid blacken the 
corresponding circles underneath. > . 

For block 10, fill in your Unit Identification Code a3$ng the top row and blacken 
the circles in the columns below. * 

DISTRIBUTE TEST BOOKLETS 

Turn to the bpoklet page with the heading "Skill Qualification Training Diagnostic 
for MOSC11B10 How to Take the Training Diagnostic. n : 

Read along with met 

This is a multiple-choice exercise similar to those you have seen before. 
The booklet is divided into UNITS. There may be as many as 8 questions 
in each UNIT. Most of the time there will be fewer than 8 questions in 
a UNIT, 

Only one alternative is to be selected .for each question in this exercise. 
You are to select the best answer for each question and blacken the circle 
on_the answer sheet that matches your selection. . PLEASE DO NOT MAKE ANY 
MARKS IN THIS BOOKLET. Mark all answers on your answer sheet. 
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Look at the sample questions and the sample answer sheet at the bottom of the- . 
pace Just above the first question is : a .General Situation. ; Each set of questions 
covering a task in you? Skill Component will be/eaded by a General Situation. , " 
Sample question nutter 1 is followed, by four anlwer choices. As you can see fron 
-' circle filled in on row 1 of the sample' ansWer 'sheet:-, the correct answer is G- - 




V 

Questions 1 through^ are. set up in 'a way that it is 1 important to become familiar 
with because it is the way some questions will be, set. up in y 9 ur Skill Component. 
The instructions read "answer either "A" (TAKE) or "B". (NOT TAKE) to questions 2 
through 5 " You remember taking ^true/false tests in school. Well this is very 
much the same thing except that the Army is actfSn oriented, so the choices 
involve actions you should take or nfit take;, The ,^ ample answer sheet shows -that 
question number 2's answer is B— NOT TAKE. Answers to questions 3 and A are also 
B-NOT TAKE- and question number 5' s answer is A- TAKE. Do you have any questions , 
about hew to" choose an answer for questions -set: up like 2 through 5? ; ^ - . 

ANSWER ANY QUESTIONS v ' % . j :•«'•. - # . /.• f .'• ■ . ■ . '. •_ 

You'll have 30, minutes to work on this exercise. You/ can ' turn, your answer sheet 
over to the side marked SC, 'open your booklet to the first question and start now. 

TIME FOR 30 MINUTES , " j • ' • " 

COLLECT BLACK PENCILS - . \ 



DISTRIBUTE RED. PENCILS .•" . - . ... 

DISTRIBUTE RESULTS SHEETS ■' *' ■ 

Look at the Results Sheet you've just received. Notice that each .task that appeared 
in the exercise just completed is listed on the results sheet: Beside each task 
is a row of numbers .. Each number stands f or a question on the ^er?ijj--you 1| / 
notice that the numbers ar* consecutive. I'm going to read each question and then 
tell you which answer. choice is correct. You'll compare the choice you selected 
for that question number/ with the one I tell you is correct If _ they are the ■ 
same draw a circle around the question number on your Results Sheet If they are 
differ^ mark an X on the quest W number on your Results Sheet When we finish 
you'll be .able to tell from the pattern of X,'s and circles where you want to spend 
more training time. Are there any questions about marking the results sheet. ^ 

ANSWER AttY QUESTIONS ] 
READ ALOUD: . 

Task Title , • 

Question Number . • ., " 

Question . 

Correct answer and phonetic letter for that answer 
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AFTER THE CORRECT ANSWER FOR THE FIRST QUESTION: 

. \ v : _/< '.> * . * ; . , 

"if you filled in (Phonetic Letter} on your answer sheets draw a circle 
^ rotmd nuSer 1 on your results sheet. If you filled in any other letter, 
~^mar k 1 with an X" . h - _ ; 

COLLECT BOOKLETS i . 

If COLLECT ANSWER SHEETS 



COLLECT RED, PENCILS 

> • ;."■-":» 

^Keep in mind that eyen if you were very successful on this exercise, you can*t be 
completely confident 'that you'll be equally successful on the for-re u cord Skill 
Cofflponent^ Ctoly half of the for-record Skill Component TASKS were tested here, 
many of the quest ion^~areHaot -exactly the^same questions you' ll see in the real 
test. We want to encourage, you to be sure to get an SQT Notice and study the 
Soldier's Manual tasks which. your SQT Notice indicates will be_tested. Remember 
' that the SQT tests the information in your Soldier's Manual. In any case in which 
i the Soldier's Stanual information is different from the way you learned to perform » 
a task in the answer SQT questions according to Soldier's Manual information. 

Another thing your SQT Notice will teli you is how your Skill Component is scored. 
Your :icore represents the percent of Scorable Units you passed — that is, on which 
you got GQ;^ Your Notice points out that it isn^t' always necessary to answer every" 
* question about a. task correctly to score GO for that Unit. The rule is that^ foy ^ 
Scorable tfiiits composed on only l^or or 3" questions - 9 all questions must be 
' answered correctly^ In thg case of more than three ^questions in 'a Scorable Unit^ 
-however , the rule is any 3 out of 4^ any 4 but of 5, any 5 out of 6, any 5 but of 
7 and any 6 tflit of 8 questions in a Scorable Unit must be answered correctly to be 
scored GO on. a particular task, Any questions? 



ANSWER ANY QUESTIONS 
THANK PARTICIPANTS 



r 



'1V 
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SQTD RECORD SHEET 



DATE INTERVIEWER 



1. (GS) 2. (QUES) 3. (ANS) , $ . (WHY NOT) 

6. (CRITICAL) ' COMMENTS ' 



1 • (GS) 2 . (QUES) 5i (ANS) 4 . (WHY NOT) 



6. (CRITICAL)— — COMMENTS 



l.(CS)^ 2. (QUES) 3. (ANS) 5 . (WHY NOT)_ 

J 

6. (CRITICAL) COMMENTS 



1. (CS) 2. (QUES) 3. (MS) U , (WHY NOT)_ 

6. (CRITICAL) COMMENTS 



4 



- l.(CS) 2. (QUES) 3 . (ANS) (TOY NOT) 



5. (CRITICAL) > , COMMENTS 



. K i - (OS) 2. (QUES) 3. (ANS*) 5;(ifY NOT)_ 

(r;:iT'TCAL) comment !— -,^ — 



SSg MPS UNIT . TASK// ITEMS 



TASK)? ftgj 



* " TASKS ITEMS 



TASK? ITEM? 



TASKS ITEMS 



TASKS y ' ITEMS 



MINI SQT RESULTS 



if telis' you about yoar preient level of preparation on some of the tasks which will be tested in your 
Ttu> categories below indicate different degrees of training needs and suggest ways to continue your 

QT. ■■'* . \ 

emphasize that success in the Mini SQT does not in any way; guarantee success in your for-record SQT. 

else serves the purpose of alerting you to training shortfalls. We .urge you to study vigorously those 

ch you reel uncertain, and thoroughly review those about which you feel confident. 

, ----- 
ASK , : , CONFIDENCE/CORRECTNESS CATEC0RIE6 



ANSWERER INCORjRECTfcY 



UNSURE OF ANSWER 



ANSWERED CORRECTLY 



UNSURE OF ANSWER 



;SURE OF ANSWER 



t 



SIS 



J 



DISTINGUISH 
CORRECT FROM 
INCORRECT INFOR- 
MATION — STUDY/ 
REHEARSE CORRECT 
TASK INFORMATION 



STUDY/REHEARSE 
CORRECT TASK 
INFORMATION 



STUDY/REHEARSE TASK 
INFORMATION 



STRENGTHEN KNOWLEDGE 
OF TASK 
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" ' ' SKILL QUALIFICATION TRAINING DIAGNOSTIC 01 



e brief exercise you have taken is intended to alert you to training shortfalls.- We wish to enipKasize' that 
in this simulated SQT does not in any- way guarantee success in your for-record SQT. We urge yo'iii to study 
sly those tasks on which you check off a substantial number of items answered incorrectlyj^and thoroughly 
those tasks on which you - answered all or most items copnectly, ' . - ••'-'•>.* . 



TASK 9 



TASK TITLE 



ITEM 



081-381-1004 x PERFORM MOUTH-TO-MOUTH RESUSCITATION AND EXTERNAL 
HEART MASSAGE 



1- 2 ,3 * '5- 6 • 



081-831-1017 ADMINISTER ANTIDOTE TO BLOOD-AGENT CASUALTY 
071-326-0513 SELECT TEMPORARY BATTLEFIELD POSITIONS 



8 9 10 11 



12 13 14 15 16 



071-329-1001 IDENTIFY TERRAIN FEATURES (NATURAL AND MANMADE) 
ON THE MAP 



47. 48, 49_ m |t 



071-317-3306 PERFORM IMMEDIATE ACTION PROCEDURES FOR A 
DRAGON MISFIRE 



071-326-0501 MOVE AS A MEMBER OF A FIRE TEAM 



Q 



2| |3 44 45 U 
.27 28 29 30 



Answer Selected 0 
:t Answer Selected ^ 
31 J -V f33) etc 



33 • v 



